A functional central limit theorem in equilibrium for a large 
network in which customers join the shortest of several queues 



Carl Graham * 



September 9, 2003. 

Abstract. We consider N single server infinite buffer queues with service rate 0. Customers arrive at rate 
Na, choose L queues uniformly, and join the shortest one. The stability condition is a < j3. We study in 
equilibrium the fraction of queues of length at least k > 0. We prove a functional central limit theorem on an 
infinite-dimensional Hilbert space with its weak topology, with limit a stationary Ornstein-Uhlenbeck process. 
We use ergodicity andjustify the inversion of limits lim;v->oo limt^oo = lim^oo liniAr^oo by a compactness- 
uniqueness method. The main tool for proving tightness of the ill-known invariant laws and ergodicity of the 
limit is a global exponential stability result for the nonlinear dynamical system obtained in the functional law 
of large numbers limit. 

Key-words: Mean-field interaction, ergodicity, equilibrium fluctuations, birth and death processes, spectral 
gap, global exponential stability, nonlinear dynamical systems 

MSC2000: Primary: 60K35. Secondary: 60K25, 60B12, 60F05, 37C75, 37A30. 



1 Introduction 

1.1 The queuing network, and some notation 

Customers arrive at rate Na on a network constituted of N > L > 1 infinite buffer single server 
queues. Each customer is allocated L distinct queues uniformly at random and joins the shortest, ties 
being resolved uniformly. Servers work at rate f3. Inter-arrival times, allocations, and services are 
independent and memoryless. For L = 1 we have i.i.d. M a /Mp/l/oo queues, and for L > 2 
the interaction structure depends only on sampling from the empirical measure of L-tuples of queue 
states. In statistical mechanics terminology, this system is in L-body mean-field interaction. 

The process p4ji<i<jv> where Xf (t) denotes the length of queue i at time t > 0, is Markov. 
Its empirical measure fi N with samples in 7 ? (B(R-f,N)) and its marginal process X N = (Xj^) t >o 
with sample paths in D(R + , 'P(N)) are given by 

i N 1 N 

^ n = nY1 ' x t N = nY1 s x?( t ) ■ 

i=l i=l 



We are interested in the tails of the distributions X^ . We consider 

V = \(v(k)) km : v(0) = 1, v(k) > v(k + 1), lim v(k) = o) C c , V^=Vn 
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with the uniform topology. Note that the uniform and the product topology coincide on V. We 
consider the process R N = (R^) t >o with sample paths in D(R + , V^) given by 

1 N 

i=i 

the fraction of queues at time t of length at least k. 

We have R^(k) = X^([k, oo[) and X*{k} = R?(k) - R? \k + 1) using the classical home- 
omorphism between V(N) and V, which maps the subspace of probability measures with finite first 
moment onto V Pi l± corresponding to having a finite number of customers. The symmetry structure 
implies that X N and R N are Markov processes. 

The network is ergodic if and only if a < j3 (Theorem 5 (a) in [ 12], Theorem 4.2 in |6|). The 
proofs use non-constructive ergodicity criteria, and we lack information and controls on the invariant 
laws (stationary distributions). We study the large N asymptotics in the stationary regime using an 
indirect approach involving ergodicity in appropriate transient regimes and an inversion of limits for 
large N and large times. Law of large numbers (LLN) results are already known, and we shall obtain 
a functional central limit theorem (CLT). 

General notation. We denote by cj] and 1® for p > 1 the subspaces of sequences vanishing at of 
the classical sequence spaces cq (with limit 0) and £ p (with summable p-th power). The diagonal 
matrix with successive diagonal terms given by the sequence a is denoted by diag(a). When using 
matrix notations, sequences vanishing at are often identified with infinite column vectors indexed 
by {1, 2, • • •}. Sequence inequalities, etc., should be interpreted termwise. Empty sums are equal 
to and empty products to 1. Constants such as K may vary from line to line. We denote by 
9e = {6 k )k>i the geometric sequence of reason 9. 

1.2 Previous results: laws of large numbers 

We relate results found in essence in Vvedenskaya et al. fT2ll . Graham [6] extended some of these 
results, and also considered the empirical measures on path space fi N , yielding chaoticity results 
(asymptotic independence of queues). (The rates v and A in [6 1 are replaced here by a and j3.) 

Consider the mappings with values in c[j given for v in Co by 

F+(v)(k) = a(v(k - 1) L - v(k) L ) , F-(v)(k) = (3{v{k) - v{k + 1)) , k > 1 , (1.1) 
and F = F + — F_ and the nonlinear differential equation ii = F(u) onV given for t > by 

u t (k) = F(u t ){k) = a(u t (k - 1) L - u t (k) L ) - P(u t (k) - u t {k + 1)) , k>l. (1.2) 

This is the infinite system of scalar differential equations (1.6) in [ 12 1 (where the arrival rate is A and 
service rate 1) and (3.9) in [6|. Note that F_ is linear. 

Theorem 1.1 There exists a unique solution u = (ut)t>o taking values in V for M.2\ . and u is in 

C(M+, V). If uq is in V l\ then u takes values in V D l\. 

Proof. We use Theorem 3.3 and Proposition 2.3 in |6). These exploit the homeomorphism be- 
tween V(N) with the weak topology and V with the product topology. Then dl.2t corresponds 
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to a non-linear forward Kolmogorov equation for a pure jump process with uniformly bounded 
(time-dependent) jump rates. Uniqueness within the class of bounded measures and existence of 
a probability-measure valued solution are obtained using the total variation norm. Theorem 1 (a) in 
[ 12 1 yields existence (and uniqueness) in V fl l\. □ 

Firstly, a functional LLN for initial conditions satisfying a LLN is part of Theorem 3.4 in [6| and 
can be deduced from Theorem 2 in lfl2l . 

Theorem 1.2 Assume that (Rq)n>l converges in law to uq in V. Then (R n )n>l converges in law 
in B(R+, V) to the unique solution u = (ut)t>o starting at u^for HI. 21 . 

Secondly, the limit equation dl.2t has a globally attractive stable point u in V n l\ . 

Theorem 1.3 For p = a/ f3 < 1 the equation M.2\ has a unique stable point u in V given by 

u = (u(k) km , u(k) = p^-WW = /*-^- 2 +-+i , 
and the solution u of \1.2\ starting at any uo in V Dli is such that lim^oo Ut = u. 

Proof. Theorem 1 (b) in [ 12 1 yields that u is globally asymptotically stable in V H l\. A stable point 
u in V satisfies (3u(k + 1) — au(k) L = (3u{k) — au(k — 1) L = • • • = (3u(l) — a and converges to 
0, hence u(l) = a//3 and u(2), n(3), ... are successively determined uniquely. □ 

Lastly, a compactness-uniqueness method justifying the inversion of limits Uni^v— >oo lim^^oo — 
lim^oo linijv^oo yields a result in equilibrium. This method was used by Whitt fT3ll for the star- 
shaped loss network, and is described in detail in Graham [5| Sections 9.5 and 9.7.3. The fol- 
lowing functional LLN in equilibrium (Theorem 4.4 in [6]) can be deduced from [12], but is not 
stated there as such; it implies using uniform integrability bounds that under the invariant laws 
limAf^oo ^(Ro (k)) = u(k) for k G N, a result stated in Theorem 5 (c) in [ 12]. 

Theorem 1.4 Let p = a/ (3 < 1 and the networks of size N > L be in equilibrium. Then (R ) n>l 
converges in probability in B(R + , V) to u. 

Note that u(k) decays hyper-exponentially in k for L > 2 instead of the exponential decay 
p k corresponding to i.i.d. queues in equilibrium (L = 1). The asymptotic large queue sizes are 
dramatically decreased by this simple choice. 

We seek rates of convergence and confidence intervals. Theorem 3.5 in [6] gives convergence 
bounds when (Xf (0))i<j<jv are i.i.d. for the variation norm on 7 3 (B([0, T], N k )) using results in 
Graham and Meleard [7]. This can be extended if the initial laws satisfy a priori controls, but it is not 
so in equilibrium, where on the contrary controls are obtained using the network evolution. 

1.3 The outline of this paper 

We consider the process R N with values in V^, a solution u = (u t )t>o for dl.2t in V, and the 
empirical fluctuation processes Z N = (Z^) t >o with sample paths in c[J given by 

Z N = N 1 / 2 (R N -u), Z t N = N 1 l\Rf -ut). (1.3) 
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We are interested in particular in the stationary regime, which defines implicitly the initial data: the 
law of Rq is the invariant law for R N and uq = u. 

Our main result is a functional CLT: in equilibrium [Z ) n>l converges in law to a stationary 
Ornstein-Uhlenbeck process, which we characterize. This implies a CLT for the marginal laws: 
under the invariant laws (Zq)n>l converges to the invariant law for this Gaussian process. This 
important result seems very difficult to obtain directly. We use ergodicity of Z N for fixed N and 
intricate fine studies of the long-time behavior of the nonlinear dynamics appearing at the large N 
limit, simply in order to prove tightness bounds for (Zq)n> l under the invariant laws and ergodicity 
for the Ornstein-Uhlenbeck process. 

Section |2] introduces the main theorems, which are proved in subsequent sections. Section |3] 
considers arbitrary uq and Rq and derives martingales of interest and the limit Ornstein-Uhlenbeck 
process. We consider the stationary regime whenever possible for simplicity, but the infinite-horizon 
bounds used for the control of the invariant laws are obtained considering transient regimes. 

We study the Ornstein-Uhlenbeck process in Section[4] We give a spectral representation for the 
linear operator in the drift term, and prove the existence of a spectral gap. A main difficulty is that 
the Hilbert space in which this operator is self-adjoint is not large enough (its norm is too strong) for 
the limit non-linear dynamical system and for the invariant laws for finite N. We obtain results of 
global exponential stability in appropriate Hilbert spaces in which it is not self-adjoint. 

In Section|5]we prove that u is globally exponentially stable for the non-linear dynamical system 
in appropriate Hilbert spaces. In Section|6l uniformly for large N, we obtain bounds for the processes 
Z N on [0, T] using martingale properties, and then for Zf uniformly for t > using the above 
result on the dynamical system in order to iterate the bounds on intervals of length T. Bounds on the 
invariant laws of Z N follow using ergodicity. We then prove the functional CLT by a compactness- 
uniqueness method and martingale characterizations. We consider the non-metrizable weak topology 
on the Hilbert spaces, and use adapted tightness criteria and the above bounds. 

2 The functional central limit theorem in equilibrium 

In this paper we concentrate on the stationary regime, and assume that p = a/ (3 < 1 and uq = u = u. 
We leave the explicit study of transient regimes for a forthcoming paper. We quickly introduce 
notation and state the main results, leaving most proofs for later. 

2.1 Preliminaries 

For any sequence w = (w(k))k>x such that w > we define the Hilbert spaces 

L 2 (w) = L G R N : x(0) = 0, \\x\\l 2{w) = W^V^) = Y J <kfw{k)~ 1 < °4 

and in matrix notation (x, y)L 2 {w) = x*diag(u;~ 1 )y. We consider the elements of Li2{w) as measures 
identified with their densities with respect to the reference measure w. Then L\(w) = i\ and if w is 
summable then ||x||i < ||tu||i IMU 2 M anc ^ ^{w) C Using ^(1) = as a pivot space, for 
bounded w we have the Gelfand triplet of Hilbert spaces Li2(w) CljC L2(w)* = L 2 (w~ 1 ). 
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Lemma 2.1 Ifw = 0{v) and v = 0(w) then the L2(v) and L%(w) norms are equivalent. 

Proof. This follows from obvious computations. □ 
We give a refined existence result for (|1.2|) . We recall that qq = (9 k )k>i- 

Theorem 2.2 Let w > be such that there exists c > and d > with 

cw(k + 1) < w(k) < dw(k + 1) , k>l. 

Then in V H L2(w) the mappings F, F + and F- are Lipschitz for the Li2{w) norm and there is 
existence and uniqueness for M.2\ . The assumptions and conclusions hold for w = gefor 6 > 0. 

Proof. The identity x L — y L = (x — y)(x L ~ 1 + x L ~ 2 y + • • • + yields 

(u(k - 1) L - v(k - l) L ) 2 w{ky l < (u{k - 1) - v(k - l)) 2 L 2 dw(k - l)- 1 , 
(u(k) L - v(k) L ) 2 w{k)- 1 < {u{k) - v(k)) 2 tfwik)- 1 , 
(u(k + 1) - v{k + l)) 2 w(k)- 1 < {u(k + 1) - v(k + l)) 2 c~ l w(k + l)" 1 , 

hence we have the Lipschitz bounds — F + (v)\\ 2 L2 ^ < 2a 2 L 2 (d + l)\\u — v\\ 2 L2 ^ and 

||F_(n) — F-{v)\\ 2 L2 ^ < 20 2 {c~ 1 + l)||n — v ll^^) and existence and uniqueness follows by a 
classical Cauchy-Lipschitz method. We have 6' _1 fc+1 < 9 k < 6* _1 6* fc+1 for k > 1. □ 



2.2 The Ornstein-Uhlenbeck process 

We consider the linear operator K, : x £ c{] h- > KLx G c[j given by 

Kx{k) = aLu(k - l) L ~ 1 x(k - 1) - {aLu(k) L ~ l + /?) x{k) + /?x(/c + 1) 
= j5L P Lk ~\(k - 1) - f/3Lp Lfc + (3) x(k) + ^(fc + 1) , k > 1 



which we identify with its infinite matrix in the canonical basis (0, 1, 0, . . .), (0, 0, 1, . 



f-((]Lp L + (3) 
(3Lp L 





V ! 



f3Lp L2 + 0) 
PLp L2 








0Lp LZ + 
PLp L3 






f3Lp Li + /? 



(2.1) 



(2.2) 



used identifying the sequence x = (0, x(l), x(2), . . . ) with its coordinates in the canonical basis 
(x(l), x(2), . . . ) taken as a column vector. 

Note that K, = A* where A is the infinitesimal generator of a sub-Markovian birth and death 
process. We shall develop this point of view and obtain a spectral decomposition for K, in Section l4l2l 
to which we give a few anticipated references below. The potential coefficients of A given by 



n = (7r(jfe)) fc >i , 7T(k) = L ^ p (L k -L)/(L-i) = p -l L k-l~^ 
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solve the detailed balance equations ir(k + 1) = Lp L ir(k) with 7r(l) = 1. 

The linearization of dl.2t around its stable point u is the linearization of the equation satisfied by 
z = u — u and is given for t > by the forward Kolmogorov equation 

z t = K,z t . (2.3) 

Let B = (B(k))kfz^ be independent Brownian motions such that B(0) = and \ax{B\{k)) = 
E(Bi(k) 2 ) = v(k) where v in cjj is given by 

v(k) = 2/3 («(jfe) - u(k + 1)) = 2/?p( Lfc - 1 )/( L ~ 1 ) (1 - p Lk ) , jfc > 1 . 

The infinitesimal covariance matrix of B is given by diag(5). 

Theorem 2.3 77ie process B is an Hilbertian Brownian motion in Li2{w) if and only if 

uik)w(k)- 1 = p (Lk ' 1)/{L ~ 1) w(k)- 1 < oo . (2.4) 
fc>i fc>i 

This is true for w = it and w = gefor 6 > when L > 2 or for w = gefor 6 > p when L = 1. 

Proof. This follows from obvious computations. □ 
The Ornstein-Uhlenbeck process Z = (Z(k))keN solves the affine SDE given for t > by 

Z t = Z + [ KZ S ds + B t (2.5) 



Jo 

which is a Brownian perturbation of (12.31 . 

Theorem 2.4 Le? w > be such that there exists c > and d > w/?/z 

cw(fc + 1) < w(k) < dp~ 2Lk w(k + 1) , k>l. 

(a) In Lziw), the operator K, is hounded, equation A2.31 has a unique solution Zt = e Zq where e^* 
has a spectral representation given by \4.1\ . and there is uniqueness of solutions for the SDE A2.5i . 
The assumptions and conclusions hold for w = ir and w = gefor 9 > 0. 

(b) In addition let w satisfy \2.4\ . The SDE H2.5t has a unique solution Z t = e Kt Z + jj e^'^ dB s 
in Li2(w), further explicited in M.2\ . The assumptions and conclusions hold for w = vr and w = gg 
for 9 > when L > 2 or for w = go for 9 > p when L = 1 . 

Theorem 2.5 (Spectral gap.) The operator K is bounded self-adjoint in L2(tt). The least point 7 
of the spectrum ofK. is such that < 7 < 0. The solution Zt = e z^for H2.3t in £2(71") satisfies 

INHl 2 (7t) < e_7 *lko||L 2 (7r)- 

The L 2 (tt) norm is too strong for studying the CLT Indeed, P(Xf H h X% > Nk) < 

P(Xi > k) + ■ ■ ■ + P{X$ > k) and since the total service rate in the system cannot exceed N/3, 
by comparison with an M^ a /M^p/1 queue, in equilibrium 

E«(A;)) = P(Xf (t) >k)> ± P Nk 

decreases at most exponentially in k > 0. Further, the mapping F + is not Lipschitz in V D L2 (it) for 
the L2 (tt) norm, see Theorem 12.21 and the contrasting assumptions and proof of Theorem 12.41 We 
prove global exponential stability in appropriate spaces. 
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Theorem 2.6 Let < 9 < 1 when L>2orp<9<\ when L = 1. 77jere ex/sfs 70 > a«ci Cg < 
00 smc/j ?/za? the solution z% = e^z^for ( 12.31 1 in L2(ge) satisfies \\zt\\L 2 (ge) < e — ' ye *C , 6i H^o ||z/ 2 (36>)- 

We deduce exponential ergodicity for the Ornstein-Uhlenbeck process, valid for any w satisfying 
the conclusions of Theorems 12.41 and 12-61 

Theorem 2.7 Let w = tt or w = gg with < 9 < 1 when L > 2 or let w = go with p < 9 < 1 
when L = 1. Any solution for the SDE ( 12.51 1 in L2(w) converges in law for large times to its unique 
invariant law (exponentially fast). This law is the law of e dBt which is Gaussian centered 
with covariance matrix f °° e / ^ t di&g(v)e lc * t dt, further explicited in ( 14.31) and i4.4l . There is a unique 
stationary Ornstein-Uhlenbeck process solving the SDE ( 12. 51) in L2(w). 



2.3 Global exponential stability for the dynamical system and tightness estimates 

Global exponential stability of the dynamical system allows control of the invariant laws using the 
long time behavior. We need uniformity over the state space, and Theorems l2.5l or l2~6l are useless for 
this purpose (except in the linear case L = 1). Such a result does not hold in I^tt) for L > 2. 

Theorem 2.8 Let p < 9 < 1 and u be the solution of ftl.2\ starting at uq in V Pi L2(gg). There exists 
70 > and Ce < 00 such that \\u t — u\\L 2 (g e ) - ^^CeWuo — ^IU 2 (fle)- 

The following finite-horizon bounds yield tightness estimates for the processes (Z n )n>l pro- 
vided the initial laws are known to satisfy similar bounds. 



Lemma 2.9 For 9 > and T > we have 



N>L 



lira sup E ( < °° => ^^(^ W Z ?\\l 2 ( 9 e) ) x ' 



Theorem 12.81 is an essential ingredient in the proof of the following infinite-horizon bound for the 
marginal laws of the processes. 

Lemma 2.10 Let p < 9 < 1 when L>2orp<9<l when L = 1. Then 

limsupE ( IIZ^II r / \ ) < 00 =^ limsupsupE ( IIZ^I1 1 , , ) < 00. 
N>L V 11 "L 2 (g e )J N>L t>0 V 11 *llL 2 ( Se ); 

This yields control of the long time limit of the marginals, the invariant law, which in turn will enable 
us to use Lemma l2~9l to prove tightness of the processes in equilibrium. 



Lemma 2.11 Let p < 9 < 1 when L>2orp<9< \ when L = 1. Then under the invariant laws 

lim S upE(||Z ( f||| 2to) ) <oo. 
N>L v 
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2.4 The main result: the functional CLT in equilibrium 

This result is obtained by a compactness-uniqueness method. We refer to Jakubowski [ 8 ] for the 
Skorokhod topology for the non-metrizable weak topology on infinite-dimensional Hilbert spaces. 

Theorem 2.12 Let the networks of size N > L be in equilibrium. For L > 2 consider L2(g p ) with 
its weak topology and B(R + , i^Sp)) with the corresponding Skorokhod topology. Then (Z n )n>l 
converges in law to the unique stationary Ornstein-Uhlenbeck process solving the SDE (12.51) . which 
is continuous and Gaussian, in particular (Zq)n>l converges in law to the invariant law for this 
process (see Theorem \2.7t . For L = 1 the same result holds in L<i{ge)for p < 9 < 1. 



3 The derivation of the limit Ornstein-Uhlenbeck process 

Let (x)k = x(x — 1) • • • (x — k + 1) for x G R denote the Jordan or falling factorial of degree k G N. 
Considering dl.lt . let the mappings F N and Fff with values in c(j be given for v in Co by 

F»=F + »-F_(„), ^).. »dkg!ii , *>i. 

The process jR-^ is Markov on V , and when in state r has jumps in its k-th coordinate, k > 1, of 
size 1/iV at rate iVFf r (r)(A;) and size -1/iV at rate NF-(r)(k). 

Lemma 3.1 Let Rq be in V N , u solve M.2\ starting at uq in V, and Z N be given by ( 17.31) . Then 

Z t N = Zl? + f N 1 ' 2 {F N (R?) - F(u s )) ds + M t N (3.1) 
J o 

defines an independent family of square integrable martingales M N = (M N (k))keN independent of 
Rq with Doob-Meyer brackets given by 

(M N (k)) t = f{F^(I^)(k)+F_(I^)(k)}d8. (3.2) 
Jo 

Proof. This follows from a classical application of the Dynkin formula. □ 

The first following combinatorial identity shows that it is indifferent to choose the L queues with 
or without replacement at this level of precision. The second one is a linearization formula. 

Lemma 3.2 For N > L and a in R we have 

y JIj j=l l<ti<-<ij<L-l V U \ 31 

andA N (a) = N^O (a) uniformly for a in [0,1]. WehaveA N (a) < Oforain {0, TV -1 , 22V -1 , . . . , 1}. 
Proof. We have 



{Na) L L j^Na-i ' 



n^-n(« + c-^) 

J— n J— n \ / 
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and by developing the product we obtain the first identity. Direct inspection of the right-hand side of 
the identity shows that A N (a) = N~ 1 0{a) uniformly for a in [0, 1]. For a in {0, N* 1 , 2iV~ 1 , . . . , 1} 
the product either is composed of terms which are positive and do not exceed a or contains a term 
equal to 0, and hence does not exceed a L . □ 

Lemma 3.3 For N > L and a and h in R we have 

B(a, h) := (a + h) L - a L - La^h = ^ ( L ) aP^h) 

i=2 ^ % ' 

with B(a, h) = for L = 1 and B(a, h) = h 2 for L = 2. For L > 2 we have < B(a, h) < 
h L + (2 L — L — 2) ah 2 for a and a + hin [0, 1]. 

Proof. Newton's binomial formula yields the identity. For a and a + hin [0, 1] and L > 2 

B(a, h) < h L + ( • ) ah 2 = h L + (2 L - L - 2) ah 2 . 

A convexity argument yields B(a, h) > 0. □ 
We define the functions G N mapping v in cq to G N (v) in c[] given by 

G N = F N — F = — F + , G N (v)(k) =aA N (v(k-l))-aA N (v(k)), k>l, (3.3) 

and K and H mapping (v, x) in cq x c§ to H(v)x and x) in c° given by 

K(v)»(fc) = aLv(k - l) L ~ l x(k - 1) - (aLw(A:) L - 1 + /9)x(fc) + + 1) , jfe > 1 , 
H(v,x)(k) = aB(v(k - l),x(k - 1)) - aB(v(k),x(k)) , fe > 1 . (3.4) 

For u and u + x in V we may use the bounds in Lemmas I3.2l and l3~3l We have 

F(v + x) - F(v) = F + (v + x) - F + (v) + F^(x) = K(v)x + H(v,x) . (3.5) 

We derive a limit equation for the fluctuations from (I3.lt and (I3.2t using (I3.3t . (13.5b . and Lem- 
mas and |^] Let u solve (ll.2t in V and (M(k))keN De independent real continuous centered 
Gaussian martingales, determined in law by their deterministic Doob-Meyer brackets given by 

(M(k)) t = I {F + (u s )(k) + F_(u s )(k)} ds . 
Jo 

The processes M = (M(k))k>o and (M) = ((M(k))) keN have sample paths with values in c[j, and 
K(itt) : z i— > K.(ut)z are linear operators on c[j. The natural limit equation for the fluctuations is the 
inhomogeneous affine SDE given for t > by 

Z t = Z + [ K(u s )Z s ds + M t . 
Jo 

We set K, = K(tt). For = u, (ll.lt and ^(n) = F-(u) yield the formulation in Section l2~2l 
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4 Main properties of the Ornstein-Uhlenbeck process 



4.1 Proof of Theorem E3 

Considering (I2.lt and convexity bounds we have 

IIMILh = 1 E (V" 1 ^ - 1) - + iM*0 + *(* + 1)) 2 



fe>l 

< [3 2 (2L + 2)^L^ / o 2Lfc ~ 1 z(A ; - l) 2 w(k)~ 1 + p 2Lk z(k) 2 w(k)~ 1 

^ fc>l fc>i 

+ E z(k) 2 w(kY 1 +Y,^(k + l) 2 w(k)-A 
k>l k>l ' 

< (3 2 {2L + 2) ( LdJ^ a(jfc - l) 2 w(k - I)- 1 + (Lp 2L + 1) ^ -z(^) 2 w(/c) _1 

+ c" 1 E + l)M fc + l)- 1 ) 
k>l ' 

< (3 2 {2L + 2) (Lp 2L + Ld + c- 1 + 1) \\z\\ 2 L2{w) . 
The Gronwall Lemma yields uniqueness. For k > 1 we have 

(Lp L )-V(A: + 1) < Tr(Jfe) = (VrM* + 1) < L' 1 p L p- 2L \(k + 1) , 

When is an Hilbertian Brownian motion, the formula for Z is well-defined and solves the equation. 

4.2 A related birth and death process, and the spectral decomposition 

Considering (12.2b . A = JC* is the infinitesimal generator of the sub-Markovian birth and death 
process on the irreducible class (1, 2, . . .) with birth rates A^ = (3Lp Lk and death rates = f3 for 
k > 1 (killed at rate pi = [3 at state 1). The process is well-defined since the rates are bounded. 

Karlin and McGregor [10 11] give a spectral decomposition for such processes, used by Callaert 
and Keilson ^ |2) and van Doom to study exponential ergodicity properties. The state space in 
these works is (0, 1,2,.. .), possibly extended by an absorbing barrier or graveyard state at —1. We 
consider (1,2,...) and adapt their notations to this simple shift. 

The potential coefficients ([ 10 1 eq. (2.2), [3] eq. (2.10)) are given by 

7r(k) = Al """ Afc - 1 = Lp Ll • • • Lp Lh - X = L k-i p V-L)/(.L-l) k > 1 
^■■■fJ-k 

and solve the detailed balance equations pk + iir{k + 1) = Afc7r(&:) with 7r(l) = 1. 

The equation AQ{x) = —xQ{x) for an eigenvector Q(x) = (Q n (x)) n >i of eigenvalue — x 
yields XiQ 2 {x) = (Ai + p± - x)Q 1 (x) and \ n Q n+ i(x) = (A n + p n - x)Q n (x) - p n Q n -i(x) for 
n > 2. With the natural convention Qq = and choice Q\ = 1, we obtain inductively Q n as the 
polynomial of degree n — 1 satisfying 

-xQ n (x) = 0Q n -i(x) - {(3Lp Ln + 0) Q n (x) + (3Lp Ln Q n+1 {x) , n > 1 . 
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These recursions correspond to [ 10 1 eq. (2.1) and [3| eq. (2.15). As stated there, such a sequence of 
polynomials is orthogonal with respect to a probability measure %jj on M + and 

Qi(x) 2 ip(dx) = vr(z) -1 , / Qi(x)Qj(x)ip(dx) = 0, i,j>l,i^j, 
o Jo 

or in matrix notation f °° Q(x)Q(x)* tp(dx) = diag(7r _1 ). 

Let Pt = (pt(i, j))i,j>i denote the sub-stochastic transition matrix for A. The adjoint matrix 
P t * is the fundamental solution for the forward Kolmogorov equation z t = A*zt = JCzt- The 
representation formula of Karlin and McGregor fTOllTTl (see (1.2) and (2.18) in [3 1) yields 



c 



,W " Pt* = (Pt(iJ))ij>i , Ptihj) = PtU, ») = <i) / ^ xt Q l {x)Q j (x) ^(dx) , (4.1) 



o 



or in matrix notation e^* = diag(7r) e xt Q(x)Q(x)* ip{dx). 

The probability measure ip is called the spectral measure, its support S is called the spectrum, 
and we set 7 = min S. The Ornstein-Uhlenbeck process in Theorem 12.41 (b) and its invariant law 
and its covariance matrix in Theorems I2.7l and l2. 12l can be written 

Z t = diag(Tr) J e- xt Q{x)* ^Z + e xs dB s ^j Q{x) 4>(dx) , (4.2) 

f'OQ f' / POO \ 

J e Kt dB t = diag(vr) J [Q(x)* J e~ xt dB t j Q(x) ij>(dx) , (4.3) 

30 e°diag(i))e /c * t dt = diag(vr) [ Q( x )* dl ^(v)Q{y) Qf x \Q( y y Md x U(dy) diagfr). (4.4) 
o J S 2 x + y 

4.3 The spectral gap, exponential stability, and ergodicity 

Proof of Theorem \2. 51 The potential coefficients (ir(k))k>i solve the detailed balance equations for 
A and hence K, = A* is self-adjoint in I^C^O- 

For the spectral gap, we follow Van Doom [3], Section 2.3. The orthogonality properties imply 
that for n > 1, Q n has n — 1 distinct zeros < x U; i < . . . < x ni „_i such that x n+ \^ < x n ^ < 
x n+ i yi+ i for 1 < i < n — 1. Hence & = lim^ooXni > exists, & < and a = lim^oo & 
exists in [0, 00]. Theorem 5.1 in establishes that 7 > if and only if a > 0, Theorem 5.3 (i) in 
[3 1 that a = (3 > 0, and Theorem 3.3 in that 7 = £1 < a. (Estimating £1 is impractical.) 

For the exponential stability, we have H^tHf,,^ = (e #0j e ^o)^^- The fact that e^* is 
self-adjoint in L2(vr) and the spectral representation (I4.lt yield 



(e u z ,e"z ) L2W = (z , e 2 ^)^ = / e-^Q^Q^)*^ i>{dx) 

J s 

< e" 2 ^ I z* Q(x)Q(x)*z il>(dx) = e~ 2 ^ (z , z ) L2(7r) . 
We refer to Callaert and Keilson [2] Section 10 for related results. 



Proof of Theorem \2. 61 ( non self-adjoint case). It is similar to and simpler than the proof for Theo- 
rem !2.8l in the interactive case L > 2, and we wait till that point to give it. 

Proof of Theorem \2. 71 We use the uniqueness result and explicit formula for Z in Theorem l2.4l and 
Theorem 12.51 or 12.61 
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5 Exponential stability for the nonlinear system 



5.1 Some comparison results 

Considering (13.5b . K, = K(n) and F{u) = 0, if n is a solution of (11.21) in V starting at no then 
y = u — u is a solution to the recentered equation starting at yo = uq — u given by 

ijtik) = Ky t {k)+H(u,y t )(k) 

= fiLp Lk ~\ t {k - 1) + aB(u(k - l),y t (k - 1)) 

- (j5Lp Lk y t (k) + aB{u(k),y t {k))+(iyt{k)) + f3y t (k + 1) , k>l, (5.1) 

and if uq is in V n l\ then u is in V n l\ and hence y is in l\ and for k > 1 

yt(fc) + y t (k + 1) + • • • = $L P Lk -\ t (k - 1) + oB(fi(A: - 1), y t (/c - 1)) - 0y t {k) . (5.2) 

Reciprocally, if y is a solution to the recentered equation (15.11) starting at yo such that yo + u is in 
V, then n = y + n is a solution of (ll.2t in V starting at no = yo + u. Then — n < y < 1 — u and 
— 1 < y < 1. For yo + u in V n i\ we have y in ^5- 

Lemma 5.1 Le? n and fte fwo solutions for M.2\ in V such that no < vq. Then ut < vtfor t > 0. 
Lef yo + n &e in V y solve i5.lt . If yo > then y t > a«<i if yo < yt < 0/or i > 0. 

Proof. Lemma 6 in [ 12 1 yields the result for (ll.2t (the proof written for L = 2 is valid for L > 1). 
The result for (I5.lt follows by consideration of the solutions u = y + u and u for dl .21 . □ 

We shall compare solutions of the nonlinear equation (I5.lt and of certain linear equations. 

Lemma 5.2 Let A. be the generator of the sub-Markovian birth and death process with birth rate 
Afc > and death rate (5 at k > 1. Let sup fc < oo. In l\ the linear operator 

A*x(k) = \ k ~ix{k - 1) - (A fc + 0)x{k) + (3x{k + 1) , k > 1 , 

is bounded and there exists a unique z = (zt)t>0 given by Zt = e" 4 t Zo solving the forward Kol- 
mogorov equation z = A*z. If zq > then zt > and if Zq < then Zt < 0. For k > 1, 
z t (k) + z t (k + 1) + • • • = \ k -iz t (k - 1) - 0zt(k). 

Proof. The operator norm in l\ of A* is bounded by 2(sup fe Afe+/3), hence existence and uniqueness. 
Uniqueness and linearity imply that if zq = then zt = and else if zq > then ^t||^o||i" is the 
instantaneous law of the process starting at zolkoIlT 1 an( ^ nence z t > 0. If zq < then — z solves the 
equation starting at — zq > and hence — z t > 0. □ 

Lemma 5.3 Let L > 2 and y = (yt)t>o solve H5.lt with yo + u in V D £i. Under the assumptions of 
Lemma \5~2\ let z = (zt)t>o solve z = A*z with zq in £® and h = (ht)t>o be given by 

h = (/i(fc))k>l , Kk) = z{k) + z(k + l) + (y(k) + y(k + 1) + • • • ). 

(a) Lef A fc > (5Lp Lk + a(l + (2 L - L - 2) u(k)) for k > 1, y > 0, W ho > 0. T/jgn /i t > Ofor 
t > 0. 

(b) Let Afc > (3Lp Lk for k > 1, y < 0, and /i < 0. 77j<?72 ^ < 0/or t > 0. 
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Proof. We prove (a). For e > let A* correspond to A| = A^ + e. The operator norm in i\ 
of A* — A* is bounded by 2e, hence lim e ^o e^Zo = z t in t\ and we may assume that A^ > 
(3Lp Lk + a{l + (2 L — L — 2) u(k)) for k > 1. Since z t = e' 4 *'zo depends continuously on zq in 
^5 we may assume ho > 0. 

Let r = inf{t > : {k > 1 : = 0} / 0} be the first time when h(k) = for some k > 1. 

Then r > and if r = 00 the proof is ended. Else, Lemma l5^2l and d5.2t yield 

M*0 = k-ivAk - 1) - PL P Lh -\ T {k - 1) - aB(u(* - 1), y T (fc - 1)) 

+ Afc-iM* - 1) - 2/r(& - 1)) - P(z T (k) - y T (k)) . 

Lemma l5TTl vields y > and Lemma 1331 and y < 1 yield 

B(u(k - l),y(k - 1)) < y(k - l) L + (2 L - L - 2) u(k - l)y(k - l) 2 

< (l + (2 L - L - 2) u(& - 1)) - 1) , 

hence Xk-iy(k — 1) — f3Lp Lk 1 y(k — 1) — aB(u(k — l),y(k — 1)) > with equality only when 
y(& - 1) = 0. For k in K = {k > 1 : /i T (A;) = 0} + we have 

z r (k - 1) - y r (/c - 1) = /i T (fc - 1) > , z T (k) - y T {k) = -h T (k + 1) < , 

with equality if only if k — 1 is in K, U {0} and k + 1 is in K,. Hence h T (k) > 0. Moreover h t (k) > 
for t < t and h T (k) = imply h T (k) < 0, hence h T (k) = 0, and the above signs and equality cases 
yield that z T (k — 1) = y T (k — 1) = and k — 1 is in K, U {0} and k + 1 is in /C. By induction 
z T {i) = y T (i) = for i > 1 which implies z t = yt = for t > r. 

The proof for (b) is similar and involves obvious changes of sign. We may assume A^ > f3Lp 
which suffices to conclude since Lemma 1331 yields B{u{k — l),y(k — 1)) > 0. □ 

Lemma 5.4 For any < 8 < 1 there exists Kg < 00 such that for x in £2(50) C $\ 

llfr(fc) + x(k + 1) + • ■ Ofc>ilL 2 ( Se ) < • 
Proof. Using a classical convexity inequality 

Y,(x(k) + x(k + l) + ---) 2 0- k 

k>l 

< ^n(x{kf + x(k + l) 2 H h x(A; + n - 2) 2 + (x(k + n - 1) + x(k + n) -\ ) 2 ) 9~ k 

k>l 

< n(l + + • • • + e n ~ 2 ) x{k) 2 9- k + n 9 n ~ l ^{x{k) + x(k + 1) + • ■ • ) 2 e- k . 

k>\ k>\ 

We take n large enough that nd Tl ~ l < 1 and Kj = (1 - n6» n - 1 )- 1 n(l - n-1 )(l - . □ 



5.2 Proofs of Theorems EUand l2\6l 

Proof of Theorem 12.81 f or L > 2. Let no be in V n L2(ge)- Then Uq = minjuo,^} and -Uq~ = 
maxjuo, tt} are in V n L2(ge)- Theorem I2.2l vields that the corresponding solutions u~ and u + for 
dl.2t are in V n L2(ge)- Lemma l5Tl vields that < u t < and < u < uf for t > 0. Then 

y = u — u , y + = u + — u > , y~ = u~ — tt < , 
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solve (I5.lt . and term wise 

1 2/0 1 = max-tyj, -y } , \y t \ < max{?/ t + , -y t ~} , t > . (5.3) 
We consider the birth and death process with generator A defined in Lemma l5~2l with 

A fc =max{pLp Lk +a(l + (2 L - L - 2) fi(jfe)) ,/36>} , fc> 1, 

which satisfies the assumptions of Lemma l5~3l (a) and (b). We perform the same spectral study as in 
Sections [4~2l and 1431 all notions being similar and denoted using a hat. 

For p < 9 < 1 we have a < (39 and hence A^ is equivalent to (39 for large k, hence Theo- 
rem 5.3 (i) in Q yields that < 7 < a = - vW) 2 = (3 (l - ^9) 2 , and moreover 

fc-l 

9 k - 1 < it(k) = 9 k - 1 Yl max ^Lp 1 " + 9~ r p{l + (2 L - L - 2) fi(jfe)) , l} 
i=l 

and the product converges using simple criteria. Hence n(k) = 0(9 k ) and 9 k = 0{n{k)) and 

Lemma|0]yields that there exists c > and d > such that c 1 1| • ||l 2 (» < II ' lUafoe) 

The version of Theorem l2.5l for the the above process yields that if z solves z = A*z in £2(50) then 

IMUaCfl,) < d\\z t \\ L2 ^) < e~ 7 *d||z || L2W < e'^cd\\z \\ L2{ge) . 
Hence if z + solves z + = A*z + starting at Zq = y$ > then Lemma l5~3l (a) and Lemma l5~4l vield 

ll^ + llL 2(9e ) < \\(yt(k) + yt(k + i) + ---) k >i\\L 2 ( gg ) 

< \\(4(k) + z+(k + l) + ---) k > l \\ L2{gg) 

< K 0\\4\\L 2 {g e ) < e-^cdKo \\y£\\L 2 (g e ) , 

and similarly if z~ solves z~ = A*z~ starting at Zq = y^ < then Lemma l5~3l (b) and Lemma l5~4l 
yield \\y^ \\ L2 ( ge ) < e^cdK^Wy^ ||i 2 ( Se ). We set 70 = 7 and C e = cdK e . Considering OJ), 

II 1 1 2 ^ 11 +||2 I || — 1|2 ^ -2yots-i2 (\\ +||2 , n — \\2 \ 

\\yt\\L 2 (g g ) S 11% Ili 2 ( 9e ) + 11% llL 2 ( 3e ) S e O e ^ 1 1 2/ \\L 2 (g e ) + 11% \\L 2 (ge) ) 

and we complete the proof by remarking that for k > 1, either y$(k) = yo(k) and %J(&) = or 
Vo( k ) = Vo(k) andy+(/c) = 0, and hence ||%j|li 2(99) + \\Vo \\l 2{gg) = HitoHi^)- 

Proof of Theorem \2.6\ and of Theorem \2.8\ f or L = 1. The linearization (I2.3t of Equation ( 11.21) is 
obtained from Equation (I5.lt by replacing the nonlinear functions B and i7 by 0, and coincides with 
(I5.lt for L = 1. Likewise, the equation for (12.31) corresponding to (I5.2t is obtained by omitting the 
term aB(u(k — l),y t (k — 1)). We obtain a result for the linear equation (12.31) corresponding to 
Lemma 1531 (a) and (b) under the sole assumption A& > (3Lp Lk for k > 1. The proof proceeds as for 
Theorem 12. 81 for L > 2 with the difference that Ajt = max {/3Lp L , 00}. We have A fc equal to (39 
for large k for < < 1 when L > 2 and for p < 6* < 1 when L = 1. 
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6 Tightness estimates and the functional central limit theorem 

6.1 Finite horizon bounds for the process: proof of Lemma IZ9l 

We use Lemma im Considering (I3.lt and (I3.3I) . 

Zf = Z™ + M t N + N 1 ' 2 f G N (Rf) ds + f N 1 ' 2 ) - F(u)) ds (6.1) 

Jo Jo 

where Lemma l3~2l vields that 

G N (R»)(k) = a(A N (R?(k - 1)) - A N (R»(k))) = N^O «(* - 1) + R?(k)) 
and hence for some K < oo 

11^(^)11, , * <N- 1 K\\Rf |L , , (6.2) 

II s ' 1 1 £2(99) — II s lli2We) v 

where 

ll-Rfllr , ^ < Nlr,r„^ + N~ 1/2 II II, , x . (6.3) 
The mapping F being Lipschitz (Theorem l2.2t . the Gronwall Lemma yields that for some Kt < oo 

^J Z "\U e) < ^(ll^L 2(se) + o Sup T ||M-|| L2(9e) + llfi^^). 

We conclude using the Doob inequality, (I3.2t . (I3.3I) . the bounds d6.2t and (16.31) . and (see Theo- 
rem 

+ F_(i?f)|| i2(9e) < K \\R^\\ L2{ge) • (6.4) 

6.2 Infinite horizon bounds for the marginals: proof of Lemma 12.101 

Let Uh(v) be the solution of (11.21) at time h > with initial value v in V, in particular u = Uh(u), 
= NV 2 (R» +h - U h (K)) for *o > 0. We have Zg +h = Z» h + (U h (R%) - u) 
and Theorem yields that 

W Z *+h\\ L2 ( ge ) ^ \\ Z tlh\\ L2{ge) +e-" leh C e K\\ L2{ge) . (6.5) 

The conditional law of {Z^ )h )h>o given R^ = r is the law of Z N started with Rq = uq = r, 
the empirical fluctuation process centered on U(r) and starting at 0. We reason as in Section l6~Tl 
using additionally (16.51) on the bound (16.31) with s = to + h. We obtain that for some < oo 



and then that for some < oo we have for < h < T 

E (K+JLgJ * L t + ^KtN-i + e-^) 2 C 2 E (K\\l 2ige) ) ■ (6-6) 
We fix T large enough for 8e- 27flT C| < e < 1. Uniformly for iV > K T e«> T , for m G N 
E (ll Z 5Ui)T|li a(ffe )) < L T + £ V(}\Z* T \\ 2 L2{g0) 
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and by induction 

m T 

■(ll^llU>)s^E^ , +^»(lWU))^i^ + B (WllL ta );. 

J'=l 

and ( I6.6t yields 



0<h<T 

hence 



sup E(i|z; T+t ||' ) <l t +8c|e(||z; t |i 2 



-p E ( ||z " l| M».)) £iT+8C ' l (i^ +E ( ||z " E 



\\L 2 (g e ) 



6.3 Bounds on the invariant laws: proof of Lemma HTTP 



Ergodicity and the Fatou Lemma yield that for distributed according to the invariant law 
E f KIlL J < liminf E ( \\Z t N \\*) < supE (llzf" 2 



L2(ge)J — t>0 V" H-Mffs)/ — VII * IlLaCffe) 



t>0 

and considering Lemma lXlOl the proof will be complete as soon as we show that we can choose Rq 
in such that 

lim S u P E(||<|| 2 2(9e) )<oo. (6.7) 

We consider L > 2, the case L = 1 being similar. Let Rq = (Rq (k))keN with 

R"(k) = iN- 1 for - (2A0 -1 < u(k) - iN^ 1 < (2N)' 1 , i G {0, 1, . . . , N} , 

and 

k(N) = inf{£; > 1 : R$(k) = 0} = inf{£; > 1 : fi(jfe) < (2iV)" 1 } . 
Since for x > and < y < 1 

y = p (L x ~i)/(L-i) ^ x = log (1 + (L - 1) log y/ log p) / log L 

& 0~* = (1 + (L - 1) logy/ log p)- losd/logL 

we have k(N) = inf {fe G N : fc > log (l + (L — 1) log ((2iV)- 1 ) /log/?) /logL}. Then 

fc(AT)-l 

II — A] 

ll£a(ff«) 



fc=l k>k(N) 

N «(fc) - ^(fc)) 2 g- fc < (47V)- 1 " _ " =0 (N- 1 {\ogN)-^°^ L ) , 

k=l 

and for large enough N (and hence k(N)) 

k>k{N) k>k{N) 

= Np nL k{N) ^)/(L^) Y p 2 (L k -L k ^)/(L-l) e -k 
k>k(N) 

< (4N)- 1 ^ /9 2ifcCiV) (^-l)/(i-l)^-(i+fc(A r )) 

j>0 

i>o 
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Hence (16.71) holds and the proof is complete. 



6.4 The functional CLT: Proof of Theorem ITHI 

Lemma l2.1 H and the Markov inequality imply that in equilibrium (Zq)n>l is asymptotically tight 
for the weak topology of L,2(g p ), for which all bounded sets are relatively compact. We consider a 
subsequence of N > L. Let (Nj)j>% denote a further subsequence such that (Z j )j>\ converges in 
law to some square-integrable in L,2(g p ). We decompose the rest of the proof in three steps. 

Step 1. We prove that (Z Nj )j>x is tight in D(R + , L,2{g p )) with the Skorokhod topology, where 
I j 2{g P ) is considered with its non-metrizable weak topology. The compact subsets of L2(g p ) are 
metrizable and hence Polish, a fact yielding tightness criteria. We easily deduce from Theorem 4.6 
and 3.1 in Jakubowski 0, which considers completely regular Hausdorff spaces (Tychonoff spaces) 
of which L,2(g p ) with its weak topology is an example, that a sufficient condition is that 

1. For each T > and e > there is a (weakly) compact subset Kt, £ of L2(g p ) such that 

P(Z N > €D([0,T],%)) > 1-e, j>l. (6.8) 

2. For each d > 1, the (f-dimensional processes (Z N ' (1), . . . , Z * {d))j>\ are tight. 

Lemma 12. 1 II implies that the assumptions of Lemma l2~9l hold. and (I6.8t follows considering the 
Markov inequality. We use (I6.lt (derived from (I3.lt ) and (I3.2t . and the bounds (16.2b . (I6.3t and 
(I6.4t . The uniform bounds in Lemma l2~9l and the fact that Z N (k) has jumps of size N~ l l 2 imply 
classically that (Z N i(l), . . . , Z N i [d))j>\ is tight, see for instance Ethier-Kurtz [4] Theorem 4.1 
p. 354 or Joffe-Metivier [9| Proposition 3.2.3 and their proofs. 

Step 2. The tightness result for (Z N i )j>\ implies it converges in law along some further subsequence 
to some Z°° with initial law given by the law of Z^°. Considering (I3.5t . we have in (I6.lt 

N 1 ' 2 {F(R^)(k) - F{u){k)) = KZ? + N l ' 2 H (u,N~ l ' 2 Z^) . (6.9) 

We likewise consider (I3.2I) . We use again the bounds (I6.2I) . (16.31) and (I6.4t . the uniform bounds in 
Lemma l2~9l and additionally (13.41) and Lemma l3~3l We deduce by a martingale characterization that 
Z°° has the law of the Ornstein-Uhlenbeck process unique solution for (12.51) in L,2{g p ) starting at 
Zq°, see Theorem l2.4l The drift vector is given by the limit for (I3.lt and (I6.lt considering ( I6.9t . and 
the diffusion matrix by the limit for (I3.2I) . See for instance Ethier-Kurtz [4| Theorem 4.1 p. 354 or 
Joffe-Metivier [9] Theorem 3.3.1 and their proofs for details. 

Step 3. The limit in law of a sequence of stationary processes is stationary (see Ethier-Kurtz |4j 
p. 131, Lemma 7.7 and Theorem 7.8). Hence the law of Z°° is the unique law of the stationary 
Ornstein-Uhlenbeck process given by (I2.5I) . see Theorem 12.71 We deduce that from every subse- 
quence we can extract a further subsequence converging in law to this process. Hence (Z n )n>l 
converges in law to this process. 
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